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* NOTICES * 

JPO and XNPIT are not responsible for any 
damages caused by the use of this translation. 

l.This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 #*** s hows the word which can not be translated. 
3. In the drawings, any words are not translated. 


CLAIMS 


[Claim(s)] 

[Claim 1] Phase which is the approach of offering the graphical user interface of the intuitive gesture 
method with which microprocessor control was carried out for [ which has a screen ] electronic 
instruments, and displays a screen object on the :A aforementioned screen (910); 

B) Phase of investigating whether said user input being equivalent to manual selection by receiving the 
user input corresponding to selection of said screen object (920), or it corresponding to a gesture input 
(930); 

C) It is the phase (940) of showing a direction pallet automatically on said screen, the case (933) where 
said user input is equivalent to manual selection — following phase: 1 — Even if said direction pallet has 
at least one pallet carbon button and does not have each **, the direction of a compass where one pallet 
carbon button is original, phase (940); which has original functional discernment, and 2 — the approach 
characterized by being constituted by phase; which performs phase (950); which receives the next user 
input corresponding to selection of said at least one pallet carbon button. 

[Claim 2] said approach — :D — the case (935) where said user input is equivalent to gesture selection — 
following phase: 1 — phase (970); which gives the user feedback which checks said gesture selection 

2) Phase where said user input judges whether it is a functional call (960); 

3) phase (980); which performs a function when said user input is a functional call (965), and 4, when 
said user input is not a functional call (963) The claim 1 publication characterized by consisting of on 
said screen, including further the phase of performing phase; which returns to the phase (940) (1 of 
Phase C) of showing a direction pallet automatically, How to offer the graphical user interface of the 
intuitive gesture method with which microprocessor control was carried out for [ which has a screen ] 
electronic instruments. 

[Claim 3] Said user feedback is the approach of offering the graphical user interface of the intuitive 
gesture method with which microprocessor control was carried out for [ which has the screen according 
to claim 2 characterized by being visual feedback ] electronic instruments. 

[Claim 4] Said user feedback is the approach of offering the graphical user interface of the intuitive 
gesture method with which microprocessor control was carried out for [ which has the screen according 
to claim 2 characterized by being audio feedback ] electronic instruments. 
[Claim 5] How to offer the graphical user interface of the intuitive gesture method with which 
microprocessor control was carried out for [ which has the screen according to claim 1 characterized by 
consisting of on said screen in front of the phase (1 of Phase C) of showing a direction pallet 
automatically, including further phase; which waits for a variable time period ] electronic instruments. 
[Claim 6] Said user input corresponding to manual selection is the approach of offering the graphical 
user interface of the intuitive gesture method with which microprocessor control was carried out for 
[ which has the screen according to claim 1 characterized by being carrying out the draw of the point ] 
electronic instruments. 

[Claim 7] Said user input corresponding to gesture selection is the approach of offering the graphical 
user interface of the intuitive gesture method with which microprocessor control was carried out for 
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[ which has the screen according to claim 1 characterized by being carrying out the draw of Rhine ] 
electronic instruments. 

[Claim 8] How to offer the graphical user interface of the intuitive gesture method with which 
microprocessor control was carried out for [ which has the screen according to claim 1 characterized by 
being constituted including further phase; which gives visual feedback behind the phase (phase B) of 
receiving a user input ] electronic instruments. 

[Claim 9] said approach — :C3 - phase (955); which investigates whether said next user input is 
equivalent to manual selection, or it corresponds to gesture selection 

4) the case where said next user input is equivalent to manual selection — following phase:5 — phase 
(960); which judges whether said next user input is a functional call 

6) phase (960); which performs a function when said next user input is a functional call (965), and 7, 
when said next user input is not a functional call (963) The claim 1 publication characterized by 
consisting of on said screen, including further phase; which performs phase; which returns to the phase 
(940) (1 of Phase C) of showing a direction pallet automatically, How to offer the graphical user 
interface of the intuitive gesture method with which microprocessor control was carried out for [ which 
has a screen ] electronic instruments. 

[Claim 10] said approach — :D — the case (935) where said user input is equivalent to gesture selection - 
- following phase: 1 -- phase (970); which gives the user feedback which checks said gesture selection 

2) Phase of judging whether said user input being a functional call (960); 

3) phase (960); which performs a function when said user input is a functional call (965), and 4, when 
said user input is not a functional call (963) The claim 9 publication characterized by consisting of on 
said screen, including further phase; which performs phase; which returns to the phase (940) (1 of Phase 
C) of showing a direction pallet automatically, How to offer the graphical user interface of the intuitive 
gesture method with which microprocessor control was carried out for [ which has a screen ] electronic 
instruments. 


[Translation done.] 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

l.This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** s hows the word which can not be translated. 
3 in the drawings, any words are not translated. 


DETAILED DESCRIPTION 


[Detailed Description of the Invention] 
[0001] 

[Industrial Application] Generally this invention relates to the graphical user interface which makes 

gesture possible in more detail about a user interface. 

[0002] 

[Description of the Prior Art] Generally, a graphical user interface uses pointing devices, such as a 
linearity menu (linear menu), a screen carbon button, and a mouse, a joy stick or a touchpad, in order to 
control electronic instruments, such as a computer or a computer control device. A pointing device 
chooses the area of a screen, in order to direct a desired function, and then, selection carbon buttons, 
such as a mouse button, order activation of the function. A menu and a screen carbon button linear in 
order to know whether which function of a user is available specify a function continuously, or show it 
by the icon, and in order for this to show a user other information, the amount of an available display 
tooth space is reduced. Since the screen space occupied with a linear menu and a screen carbon button is 
stopped to the minimum, other sub menus put additional alternative in order and pulldown **** can 
present an additional function at the time of selection of a main menu item. 

[0003] A "gesture" user interface is used for the electronic product of some Penn methods or a stylus 
method as shortcut for performing the function used frequently. However, gesture is available only as an 
addition to the graphical user interface of the conventional linear menu and a screen carbon button, 
therefore the problem of reduction of any user interface of a class of screen space remains. It is easy and 
a gesture user interface enables quick access to a function by the familiar motion. For example, a word 
will be eliminated if a user does strike through [ of the word ] simply (from the left to the right) using a 
stylus instead of choosing an alphabetic character eliminating using a pointing device, and pushing 
"elimination" carbon button. Though regrettable, most available gesture is not so intuitive as the 
example of this deletion. Moreover, gesture shortcut differs from the linear menu and screen carbon 
button which attain the same function radically. 
[0004] 

[Problem(s) to be Solved by the Invention] Therefore, these gesture user interfaces mean being only 
used for skillful users. An entry level user does not have the means which check easily which gesture is 
available. An entry level user must learn available gesture and its function from user documentation or 
onscreen "help" documentation first, and must pass through the process which memorizes these gesture 
next. When gesture has been forgotten, it must return to documentation and a user has to dare try hard 
that the relearning of gesture and its function should be carried out. Therefore, the user interface of the 
gesture method with which a user can access quickly the function frequently used on an electronic 
instrument, and can moreover exclude the troublesomeness of documentation and which is easy to learn 
is needed. Moreover, the user interface of a gesture method which reduces the need for the linear menu 
which consumes a display tooth space, and a screen carbon button is required. 
[0005] 

[Example] With the graphical user interface of an intuitive gesture method, a user can learn gesture 


http://www4.ipdl.inpit.go.jp/cgi-bin/tran__web__cgLejje 


1 1/6/2007 


JP, 10-105324, A [DETAILED DESCRIPTION] 


Page 2 of 5 


quickly as an approach of accessing the function of the device of a computer or the computer base used 
frequently. Moreover, the graphical user interface of this intuitive gesture method mitigates the need for 
a screen carbon button of decreasing available screen space. The graphical user interface of an intuitive 
gesture method is preferably carried out using the device of Penn or a stylus method, and a user 
performs manual selection of a screen item by carrying out a tap on a pressure-sensitive screen, or 
carrying out the draw of the point using a stylus. After a single tap, a device presents the direction pallet 
equipped with the pallet carbon button which has the different direction of a compass to the core of a 
direction pallet. Each pallet carbon button specifies the original discernment showing other items of a 
function or information. For example, by the 2nd tap, the available function and the corresponding 
gesture of equipment understand an entry level user by making manual selection of the desired pallet 
carbon button. A user can carry out the draw of Rhine in the suitable direction of a compass which 
begins from the screen object which earned out the tap twice continuously on the screen object, or was 
chosen, and equipment processes this gesture selection appropriately, without displaying a direction 
pallet as a user grows familiar with an electronic instrument. 

[0006] Drawing 1 shows drawing of the graphical user interface of the intuitive gesture method by the 
suitable example carried out on an electronic instrument. An electronic instrument 100 is the device of a 
computer or a microcomputer method preferably. An electronic instrument 100 is shown by this drawing 
as an one apparatus wireless communication device equipped with radiotelephony, the electronic mail, 
and the facsimile function. However, the combination of the desktop computer equipped with a modem 
(a modulator/demodulator) or a portable computer, and television/VCR, facsimile apparatus, a 
photocopying machine, a Personal Digital Assistant, etc. are sufficient as an electronic instrument 100. 
An electronic instrument 100 has the pressure-sensitive screen 150 and a push button 120. The pointing 
devices 190, such as Penn or a stylus, act on a screen 150 and mutual, and choose the area of a screen. 
Of course, other pointing devices, such as a finger of a mouse, a joy stick, a touchpad, or human being, 
can be used instead of Penn or a stylus. 

[0007] Draw in g 2 shows the detail of the screen of the electronic instrument shown in drawing^l by the 
suitable example. The list of received messages in an electronic mail box etc. displays one or the screen 
object 210,220,230 beyond it so that this screen may be directed by the microprocessor. A screen object 
is the graphical expression of data. Although an electronic mail software program is used in this 
example The address book program which has an alphabet index as a screen object, The scheduling 
program which has a calender date as a screen object, The memorandum or two Do Liszt who has a list 
item as a screen object, The screen object of other classes can be substituted for many other programs, 
such as an electronic program suitable for functions, such as an electronic game which has a direction 
carbon button as a screen object, and photocopying or a facsimile transmission. 
[0008] There are the two approaches of choosing a screen object and a related function. Manual 
selection of a screen object of carrying out the draw of a tap or the point calls automatically the direction 
pallet equipped with the pallet carbon button which has the clear discernment which shows the function 
corresponding to the screen object by which manual selection was made. Manual selection of pallet 
carbon buttons, such as the 2nd tap of a desired pallet carbon button, directs activation of the specified 
function. On the other hand, gesture selection can specify both a screen object and a function as 
coincidence. Starting from a screen object, gesture selection of carrying out the draw of Rhine which 
progresses in the specific direction directs a desired screen object from the start point of Rhine, and 
directs a desired function from the direction where the draw of Rhine is carried out. 
[0009] In order to make manual selection of the screen object, the tap of the entry level user is 
intuitively carried out on a screen object, or it carries out the draw of the point, and chooses an 
electronic mail message. Drawing 3 shows the detail of the screen shown in drawing 2 at the time of a 
user performing manual selection of a screen object by this invention. An electronic instrument gives a 
user visual feedback by highlighting preferably the area 310 which carried out the tap. Audio feedback 
may be given to a user as an option. An electronic instrument shows a user automatically the direction 
pallet centered on the area of the same screen which a tap or the point produced preferably after manual 
selection, such as carrying out the draw of a single tap or the point. 
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[0010] Drawing 4 shows the detail of the screen shown in drawin g 2 at the time of a direction pallet 
being displayed by the suitable example. The direction pallet 450 shows a user many pallet carbon 
buttons. Although the direction pallet 450 of illustration shows a user five pallet carbon buttons, a 
direction pallet may present the carbon button more than it or not more than it if needed. The 
configuration, dimension, and configuration of a direction pallet differ from each other according to 
which screen object was chosen. Each pallet carbon button has an original direction to the core of the 
direction pallet which is also the approximation location of the 1st tap preferably, and these directions 
are also called direction of a compass. Moreover, the functional discernment which describes or shows 
which function each pallet carbon button can access by starting this pallet carbon button is displayed. 
[001 1] A screen object expresses a reception mail message with the example of this electronic mail. 
Therefore, the direction pallet 450 which appears when manual selection of the reception mail message 
screen object is made has the pallet carbon button 451 which accesses a cancellation function on the 
north side. In the option which accesses this cancellation function, the tap of the part of the screen of the 
outside of a pallet is earned out. A cancellation function eliminates a current pallet from a screen, or 
returns the last action. At the east side, a user chooses the pallet carbon button 452 and is a transfer 
(forward) to another addressee about a message. It can do. On the south, the pallet carbon button 453 
directs deletion of a message, and the pallet carbon button 454 demands return to the transmitting person 
of a message from a user on in the West. Finally, the central pallet carbon button 455 enables a user to 
read a message. Even if it carries out the tap of which pallet carbon button, the function specified on the 
pallet carbon button is called. 

[0012] In order that a user may help to learn and memorize an available functional option and its related 
gesture, a direction pallet presents a functional option preferably as logically as possible. In this 
example, "return" is the west side and "a transfer" is the east side. Therefore, in a user, "return" retreats 
anyhow and it turns out intuitively that "a transfer" moves forward anyhow. 

[0013] Drawing 5 shows the detail of the screen which shows a pallet carbon button to drawi ng 2 at the 
time of making manual selection on the direction pallet which a user shows to drawin g 4 according to a 
suitable example. Manual selection of a pallet carbon button is carried out using the 2nd tap. If the tap of 
the central pallet carbon button 455 is carried out, a screen just before highlighting this pallet carbon 
button temporarily and showing it in drawing 2 will be changed to the selected electronic message 
screen so that a microprocessor may blink. Therefore, a user can read the message chosen by the 1st tap 
by the 2nd tap. Thus, the direction pallet 450 teaches a user carrying out a "double-tap", in order to read 
the selected message. 

[0014] By the direction pallet furthermore shown in drawing 5 , the 2nd tap on "return" pallet carbon 
button on the left-hand side of the 1st tap calls a return screen. The gesture corresponding to this is 
Rhine which carried out the draw to the left from the right as shown in drawing 6 . Drawin g 6 shows the 
detail of the screen shown in drawing 2 at the time of a user performing a screen object and gesture 
selection of a function according to a suitable example. Rhine which carried out the draw to the left is 
pursued from the right on the screen object 220 gesture and here using Rhine 620 on a screen. If return 
gesture is recognized by the microprocessor, the return pallet carbon button 454 appears, it will blink in 
order to give visual feedback, and when a user makes manual selection of the return pallet from a 
direction pallet, completely as a return screen appears, a return screen will appear. In addition, the 
mental model for accessing a function should care about that it is the same for both entry level user and 
skillful user. Therefore, the individual and redundant screen carbon button for entry level users is 
unnecessary any longer. 

[0015] In order to access an available function, it becomes unnecessary for a user to wait for a direction 
pallet to appear, if a user memorizes gesture. Therefore, it teaches carrying out the gesture of the 
graphical user interface of this intuitive gesture method to an entry level user as the first meaning- 
approach for having a dialog with equipment. The graphical user interface of an intuitive gesture method 
specifies a program function by combining the graphical user interface of a gesture method with a 
direction pallet. However, since a user can have a dialog with equipment before a direction pallet is 
shown, only when required, he urges more efficient use of a screen to the graphical user interface of this 
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intuitive gesture method by providing a user with an explicit functional option. Furthermore, by offering 
the same mental model as both entry level user and skillful user, he can graduate from a beginner user 
more easily and it can become a skillful user. 

[0016] Drawing 7 shows the detail of the screen which shows a pallet carbon button to drawing 2 at the 
time of making manual selection on the direction pallet which a user shows to drawing 4 according to 
another suitable example. In order to make the gesture and the accessible function of a number of 
arbitration, the "stack" of the direction pallet may be carried out. If the tap of the west side pallet carbon 
button 454 top described as "return" is carried out, the subpallet 750 will be called. The subpallet 750 
gives only the pallet carbon button 751 of the northwest for returning two pallet carbon buttons, i.e., the 
transmitting person of a message, and the pallet carbon button 753 of the southwest for choosing from 
Liszt, a possible addressee. The subpallet 750 can carry out a stack to infinity, and can hold the pallet 
carbon button of the number of arbitration. 

[0017] Drawin g 8 shows the detail of the screen shown in dr awi ng 2 at the time of a user performing 
gesture selection of a screen object according to another suitable example. In the example of the pallet 
which carried out the stack, gesture selection calls a subpallet to a user, or carries out direct access of the 
function. In this example, gesture Rhine 620 is lengthened by the user and the subpallet 750 appears. 
However, if this gesture continues northwestward, the return pallet carbon button 454 appears first, and 
it blinks, and next, the pallet carbon button 751 will appear, it will blink, and the return screen addressed 
to the transmitting person John of a message will replace a current screen. Therefore, both a pallet 450 
and the subpallet 750 are omissible by using gesture. 

[0018] Drawing 9 shows the flow chart Fig. of actuation of the graphical user interface of the intuitive 
gesture method by the suitable example. It is the initiation step 901, next as shown in step 910, an 
electronic instrument displays one or the object beyond it. Next, as shown in step 920, equipment waits 
for a user input. If a user input is received, some screens will be highlighted and it will give a user visual 
feedback. Moreover, equipment can give a user audio feedback. In step 930, it investigates whether 
equipment is whether the received user input is manual selection of a screen object, and gesture 
selection. If it is judged with a user input being manual selection (for example, tap) so that it may be 
shown by branching 933, equipment will display a direction pallet, as shown in step 940. Here, it 
investigates whether equipment is whether the user input received as a user input was highlighted as 
shown in waiting and step 950, and a user input was shown in step 955 is a tap, and gesture. 
[0019] When the next user input is a tap, as shown in step 960, as for a microprocessor, a user input 
investigates whether it is a functional call. When the next user input is gesture, the pallet carbon button 
chosen as shown in step 970 is displayed as visual feedback, and as a microprocessor is shown in step 
960, then, a user input investigates whether it is a functional call. Here, audio feedback can be used in 
order to check gesture selection. 

[0020] As investigated at step 960, when a user input is not a functional call, equipment displays return 
and the following direction pallet (namely, subpallet) on step 940. The effectiveness of the pallet which 
carried out the stack is acquired by the loop formation 963, and this loop formation can be executed any 
number of times as required, until a user input serves as a functional call so that it may be shown by 
branching 965. If a functional call is chosen, equipment will blink the selected pallet carbon button, and 
a microprocessor will perform a function, as shown in step 980. 

[0021] It returns to step 930, and if it is judged with an initial user input being gesture selection as 
shown in branching 935, in step 970, equipment will display the pallet carbon button chosen by gesture 
selection, and will give a user visual feedback. Next, as for equipment, direct progress and gesture judge 
whether it is a functional call to step 960. If the selected function is performed, the termination step 990 
can arise and equipment can return to the initiation step 901. 

[0022] As an option, the timing of an appearance of a direction pallet does not wait for a direction pallet 
to appear simply, before an entry level user performs the 2nd tap, but it may change in order to urge 
using gesture selection. For example, when using equipment first, a direction pallet appears quickly in 
response to a single tap. When a direction pallet appears quickly, a user can study an available function 
and its corresponding gesture first. Time amount after the 1st tap produces a direction pallet until it 
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appears becomes long gradually as it studies that it takes the 2nd tap for a specific approach, in order 
that a user may start a specific function. Therefore, before a direction pallet appears, it becomes easy for 
the user it became impossible to bear to perform the 2nd tap. When a user does a tap twice or the draw 
of Rhine is carried out before a direction pallet appears, it means that the user had adopted gesture 
selection, without daring strive memorizing gesture. When the user has forgotten gesture, a user should 
just wait until a direction pallet appears in a screen after the 1st tap, in order to do the relearning of 
gesture and the related function. 

[0023] As mentioned above, the graphical user interface of an intuitive gesture method teaches a user 
the gesture for having a dialog with the electronic instrument by which microprocessor control was 
carried out quickly and briefly. Although the specific component and specific function of a graphical 
user interface of this intuitive gesture method have been explained, if it is this contractor, moreover it is 
more few, an additional function can be adopted without deviating from the true pneuma and the true 
range of this invention. This invention shall be restricted by only the claim. 


[Translation done.] 


http://www4.ipdl.inpit.go. jp/cgi-bin/tran„web_cgi__ejje 


11/6/2007 


JP,10-105324,A [TECHNICAL FIELD] 


Page 1 of 1 


* NOTICES * 

JPO and INPIT are not responsible for any 
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3. In the drawings, any words are not translated. 


TECHNICAL FIELD 


[Industrial Application] Generally this invention relates to the graphical user interface which makes 
gesture possible in more detail about a user interface. 


[Translation done.] 
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* NOTICES * 

JPO and INPXT are not responsible for any 
damages caused by the use of this translation. 

l.This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 


PRIOR ART 


[Description of the Prior Art] Generally, a graphical user interface uses pointing devices, such as a 
linearity menu (linear menu), a screen carbon button, and a mouse, a joy stick or a touchpad, in order to 
control electronic instruments, such as a computer or a computer control device. A pointing device 
chooses the area of a screen, in order to direct a desired function, and then, selection carbon buttons, 
such as a mouse button, order activation of the function. A menu and a screen carbon button linear in 
order to know whether which function of a user is available specify a function continuously, or show it 
by the icon, and in order for this to show a user other information, the amount of an available display 
tooth space is reduced. Since the screen space occupied with a linear menu and a screen carbon button is 
stopped to the minimum, other sub menus put additional alternative in order and pulldown **** can 
present an additional function at the time of selection of a main menu item. 

[0003] A "gesture" user interface is used for the electronic product of some Penn methods or a stylus 
method as shortcut for performing the function used frequently. However, gesture is available only as an 
addition to the graphical user interface of the conventional linear menu and a screen carbon button, 
therefore the problem of reduction of any user interface of a class of screen space remains. It is easy and 
a gesture user interface enables quick access to a function by the familiar motion. For example, a word 
will be eliminated if a user does strike through [ of the word ] simply (from the left to the right) using a 
stylus instead of choosing an alphabetic character eliminating using a pointing device, and pushing 
"elimination" carbon button. Though regrettable, most available gesture is not so intuitive as the 
example of this deletion. Moreover, gesture shortcut differs from the linear menu and screen carbon 
button which attain the same function radically. 


[Translation done.] 
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* NOTICES * 

JPO and INPXT are not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 


TECHNICAL PROBLEM 


[Problem(s) to be Solved by the Invention] Therefore, these gesture user interfaces mean being only 
used for skillful users. An entry level user does not have the means which check easily which gesture is 
available. An entry level user must learn available gesture and its function from user documentation or 
onscreen "help" documentation first, and must pass through the process which memorizes these gesture 
next. When gesture has been forgotten, it must return to documentation and a user has to dare try hard 
that the relearning of gesture and its function should be carried out. Therefore, the user interface of the 
gesture method with which a user can access quickly the function frequently used on an electronic 
instrument, and can moreover exclude the troublesomeness of documentation and which is easy to learn 
is needed. Moreover, the user interface of a gesture method which reduces the need for the linear menu 
which consumes a display tooth space, and a screen carbon button is required. 


[Translation done.] 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3 in the drawings, any words are not translated. 


EXAMPLE 


[Example] With the graphical user interface of an intuitive gesture method, a user can learn gesture 
quickly as an approach of accessing the function of the device of a computer or the computer base used 
frequently. Moreover, the graphical user interface of this intuitive gesture method mitigates the need for 
a screen carbon button of decreasing available screen space. The graphical user interface of an intuitive 
gesture method is preferably earned out using the device of Penn or a stylus method, and a user 
performs manual selection of a screen item by carrying out a tap on a pressure-sensitive screen, or 
carrying out the draw of the point using a stylus. After a single tap, a device presents the direction pallet 
equipped with the pallet carbon button which has the different direction of a compass to the core of a 
direction pallet. Each pallet carbon button specifies the original discernment showing other items of a 
function or information. For example, by the 2nd tap, the available function and the corresponding 
gesture of equipment understand an entry level user by making manual selection of the desired pallet 
carbon button. A user can carry out the draw of Rhine in the suitable direction of a compass which 
begins from the screen object which carried out the tap twice continuously on the screen object, or was 
chosen, and equipment processes this gesture selection appropriately, without displaying a direction 
pallet as a user grows familiar with an electronic instrument. 

[0006] Drawing 1 shows drawing of the graphical user interface of the intuitive gesture method by the 
suitable example carried out on an electronic instrument. An electronic instrument 100 is the device of a 
computer or a microcomputer method preferably. An electronic instrument 100 is shown by this drawing 
as an one apparatus wireless communication device equipped with radiotelephony, the electronic mail, 
and the facsimile function. However, the combination of the desktop computer equipped with a modem 
(a modulator/demodulator) or a portable computer, and television/VCR, facsimile apparatus, a 
photocopying machine, a Personal Digital Assistant, etc. are sufficient as an electronic instrument 100. 
An electronic instrument 100 has the pressure-sensitive screen 150 and a push button 120. The pointing 
devices 190, such as Penn or a stylus, act on a screen 150 and mutual, and choose the area of a screen. 
Of course, other pointing devices, such as a finger of a mouse, a joy stick, a touchpad, or human being, 
can be used instead of Penn or a stylus. 

[0007] Drawing 2 shows the detail of the screen of the electronic instrument shown in drawing 1 by the 
suitable example. Liszt of the received message in an electronic mail box etc. displays one or the screen 
object 210,220,230 beyond it so that this screen may be directed by the microprocessor. A screen object 
is the graphical expression of data. Although an electronic mail software program is used in this 
example The address book program which has an alphabet index as a screen object, The scheduling 
program which has a calender date as a screen object, The memorandum or two Do Liszt who has the 
Liszt item as a screen object, The screen object of other classes can be substituted for many other 
programs, such as an electronic program suitable for functions, such as an electronic game which has a 
direction carbon button as a screen object, and photocopying or a facsimile transmission. 
[0008] There are the two approaches of choosing a screen object and a related function. Manual 
selection of a screen object of carrying out the draw of a tap or the point calls automatically the direction 
pallet equipped with the pallet carbon button which has the clear discernment which shows the function 
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corresponding to the screen object by which manual selection was made. Manual selection of pallet 
carbon buttons, such as the 2nd tap of a desired pallet carbon button, directs activation of the specified 
function. On the other hand, gesture selection can specify both a screen object and a function as 
coincidence. Starting from a screen object, gesture selection of carrying out the draw of Rhine which 
progresses in the specific direction directs a desired screen object from the start point of Rhine, and 
directs a desired function from the direction where the draw of Rhine is carried out. 
[0009] In order to make manual selection of the screen object, the tap of the entry level user is 
intuitively carried out on a screen object, or it carries out the draw of the point, and chooses an 
electronic mail message. Drawin g 3 shows the detail of the screen shown in drawing 2 at the time of a 
user performing manual selection of a screen object by this invention. An electronic instrument gives a 
user visual feedback by highlighting preferably the area 310 which carried out the tap. Audio feedback 
may be given to a user as an option. An electronic instrument shows a user automatically the direction 
pallet centered on the area of the same screen which a tap or the point produced preferably after manual 
selection, such as carrying out the draw of a single tap or the point. 

[0010] D rawing 4 shows the detail of the screen shown in drawing 2 at the time of a direction pallet 
being displayed by the suitable example. The direction pallet 450 shows a user many pallet carbon 
buttons. Although the direction pallet 450 of illustration shows a user five pallet carbon buttons, a 
direction pallet may present the carbon button more than it or not more than it if needed. The 
configuration, dimension, and configuration of a direction pallet differ from each other according to 
which screen object was chosen. Each pallet carbon button has an original direction to the core of the 
direction pallet which is also the approximation location of the 1st tap preferably, and these directions 
are also called direction of a compass. Moreover, the functional discernment which describes or shows 
which function each pallet carbon button can access by starting this pallet carbon button is displayed. 
[001 1] A screen object expresses a reception mail message with the example of this electronic mail. 
Therefore, the direction pallet 450 which appears when manual selection of the reception mail message 
screen object is made has the pallet carbon button 451 which accesses a cancellation function on the 
north side. In the option which accesses this cancellation function, the tap of the part of the screen of the 
outside of a pallet is carried out. A cancellation function eliminates a current pallet from a screen, or 
returns the last action. At the east side, a user chooses the pallet carbon button 452 and is a transfer 
(forward) to another addressee about a message. It can do. On the south, the pallet carbon button 453 
directs deletion of a message, and the pallet carbon button 454 demands return to the transmitting person 
of a message from a user on in the West. Finally, the central pallet carbon button 455 enables a user to 
read a message. Even if it carries out the tap of which pallet carbon button, the function specified on the 
pallet carbon button is called. 

[0012] In order that a user may help to learn and memorize an available functional option and its related 
gesture, a direction pallet presents a functional option preferably as logically as possible. In this 
example, "return" is the west side and H a transfer" is the east side. Therefore, in a user, "return" retreats 
anyhow and it turns out intuitively that "a transfer" moves forward anyhow. 

[0013] Drawing 5 shows the detail of the screen which shows a pallet carbon button to drawin g 2 at the 
time of making manual selection on the direction pallet which a user shows to drawi ng 4 according to a 
suitable example. Manual selection of a pallet carbon button is carried out using the 2nd tap. If the tap of 
the central pallet carbon button 455 is carried out, a screen just before highlighting this pallet carbon 
button temporarily and showing it in dr aw ing 2 will be changed to the selected electronic message 
screen so that a microprocessor may blink. Therefore, a user can read the message chosen by the 1st tap 
by the 2nd tap. Thus, the direction pallet 450 teaches a user carrying out a "double-tap", in order to read 
the selected message. 

[0014] By the direction pallet furthermore shown in draw ing 5 , the 2nd tap on "return" pallet carbon 
button on the left-hand side of the 1st tap calls a return screen. The gesture corresponding to this is 
Rhine which carried out the draw to the left from the right as shown in drawing 6 . Drawing 6 shows the 
detail of the screen shown in drawin g 2 at the time of a user performing a screen object and gesture 
selection of a function according to a suitable example. Rhine which carried out the draw to the left is 
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pursued from the right on the screen object 220 gesture and here using Rhine 620 on a screen. If return 
gesture is recognized by the microprocessor, the return pallet carbon button 454 appears, it will blink in 
order to give visual feedback, and when a user makes manual selection of the return pallet from a 
direction pallet, completely as a return screen appears, a return screen will appear. In addition, the 
mental model for accessing a function should care about that it is the same for both entry level user and 
skillful user. Therefore, the individual and redundant screen carbon button for entry level users is 
unnecessary any longer. 

[0015] In order to access an available function, it becomes unnecessary for a user to wait for a direction 
pallet to appear, if a user memorizes gesture. Therefore, it teaches carrying out the gesture of the 
graphical user interface of this intuitive gesture method to an entry level user as the first meaning- 
approach for having a dialog with equipment. The graphical user interface of an intuitive gesture method 
specifies a program function by combining the graphical user interface of a gesture method with a 
direction pallet. However, since a user can have a dialog with equipment before a direction pallet is 
shown, only when required, he urges more efficient use of a screen to the graphical user interface of this 
intuitive gesture method by providing a user with an explicit functional option. Furthermore, by offering 
the same mental model as both entry level user and skillful user, he can graduate from a beginner user 
more easily and it can become a skillful user. 

[0016] Drawing 7 shows the detail of the screen which shows a pallet carbon button to drawing 2 at the 
time of making manual selection on the direction pallet which a user shows to drawing 4 according to 
another suitable example. In order to make the gesture and the accessible function of a number of 
arbitration, the "stack" of the direction pallet may be carried out. If the tap of the west side pallet carbon 
button 454 top described as "return" is carried out, the subpallet 750 will be called. The subpallet 750 
gives only the pallet carbon button 751 of the northwest for returning two pallet carbon buttons, i.e., the 
transmitting person of a message, and the pallet carbon button 753 of the southwest for choosing from 
Liszt, a possible addressee. The subpallet 750 can carry out a stack to infinity, and can hold the pallet 
carbon button of the number of arbitration. 

[0017] Drawing 8 shows the detail of the screen shown in drawing 2 at the time of a user performing 
gesture selection of a screen object according to another suitable example. In the example of the pallet 
which carried out the stack, gesture selection calls a subpallet to a user, or carries out direct access of the 
function. In this example, gesture Rhine 620 is lengthened by the user and the subpallet 750 appears. 
However, if this gesture continues northwestward, the return pallet carbon button 454 appears first, and 
it blinks, and next, the pallet carbon button 751 will appear, it will blink, and the return screen addressed 
to the transmitting person John of a message will replace a current screen. Therefore, both a pallet 450 
and the subpallet 750 are omissible by using gesture. 

[0018] Drawing 9 shows the flow chart Fig. of actuation of the graphical user interface of the intuitive 
gesture method by the suitable example. It is the initiation step 901, next as shown in step 910, an 
electronic instrument displays one or the object beyond it. Next, as shown in step 920, equipment waits 
for a user input. If a user input is received, some screens will be highlighted and it will give a user visual 
feedback. Moreover, equipment can give a user audio feedback. In step 930, it investigates whether 
equipment is whether the received user input is manual selection of a screen object, and gesture 
selection. If it is judged with a user input being manual selection (for example, tap) so that it may be 
shown by branching 933, equipment will display a direction pallet, as shown in step 940. Here, it 
investigates whether equipment is whether the user input received as a user input was highlighted as 
shown in waiting and step 950, and a user input was shown in step 955 is a tap, and gesture. 
[0019] When the next user input is a tap, as shown in step 960, as for a microprocessor, a user input 
investigates whether it is a functional call. When the next user input is gesture, the pallet carbon button 
chosen as shown in step 970 is displayed as visual feedback, and as a microprocessor is shown in step 
960, then, a user input investigates whether it is a functional call. Here, audio feedback can be used in 
order to check gesture selection. 

[0020] As investigated at step 960, when a user input is not a functional call, equipment displays return 
and the following direction pallet (namely, subpallet) on step 940. The effectiveness of the pallet which 
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carried out the stack is acquired by the loop formation 963, and this loop formation can be executed any 
number of times as required, until a user input serves as a functional call so that it may be shown by 
branching 965. If a functional call is chosen, equipment will blink the selected pallet carbon button, and 
a microprocessor will perform a function, as shown in step 980. 

[0021] It returns to step 930, and if it is judged with an initial user input being gesture selection as 
shown in branching 935, in step 970, equipment will display the pallet carbon button chosen by gesture 
selection, and will give a user visual feedback. Next, as for equipment, direct progress and gesture judge 
whether it is a functional call to step 960. If the selected function is performed, the termination step 990 
can arise and equipment can return to the initiation step 901. 

[0022] As an option, the timing of an appearance of a direction pallet does not wait for a direction pallet 
to appear simply, before an entry level user performs the 2nd tap, but it may change in order to urge 
using gesture selection. For example, when using equipment first, a direction pallet appears quickly in 
response to a single tap. When a direction pallet appears quickly, a user can study an available function 
and its corresponding gesture first. Time amount after the 1st tap produces a direction pallet until it 
appears becomes long gradually as it studies that it takes the 2nd tap for a specific approach, in order 
that a user may start a specific function. Therefore, before a direction pallet appears, it becomes easy for 
the user it became impossible to bear to perform the 2nd tap. When a user does a tap twice or the draw 
of Rhine is carried out before a direction pallet appears, it means that the user had adopted gesture 
selection, without daring strive memorizing gesture. When the user has forgotten gesture, a user should 
just wait until a direction pallet appears in a screen after the 1st tap, in order to do the relearning of 
gesture and the related function. 

[0023] As mentioned above, the graphical user interface of an intuitive gesture method teaches a user 
the gesture for having a dialog with the electronic instrument by which microprocessor control was 
carried out quickly and briefly. Although the specific component and specific function of a graphical 
user interface of this intuitive gesture method have been explained, if it is this contractor, moreover it is 
more few, an additional function can be adopted without deviating from the true pneuma and the true 
range of this invention. This invention shall be restricted by only the claim. 
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DESCRIPTION OF DRAWINGS 


[Brief Description of the Drawings] 

[Drawing 1] It is drawing showing the graphical user interface of the intuitive gesture method by the 
suitable example carried out on an electronic instrument. 

[Drawing 2] It is drawing showing the detail of the screen of the electronic instrument shown in drawing 
1 by the suitable example. 

[Drawing 3] It is drawing showing the detail of the screen shown in draw ing 2 at the time of a user 
performing manual selection of a screen object according to a suitable example. 
[Drawing 4] It is drawing showing the detail of the screen shown in d ra wing 2 at the time of a direction 
pallet being displayed by the suitable example. 

[ Drawing 5 ] It is drawing showing the detail of the screen which shows the pallet carbon button on the 
direction pallet which a user shows to drawin g 4 according to a suitable example to drawi ng 2 at the 
time of making manual selection. 

[ Drawing 6] It is drawing showing the detail of the screen shown in drawing 2 at the time of a user 
making gesture selection of a screen object and the function according to a suitable example. 
[Drawing 7] It is drawing showing the detail of the screen which shows the pallet carbon button on the 
direction pallet which a user shows to drawing 4 according to another suitable example to drawing 2 at 
the time of making manual selection. 

[Drawing 8] It is drawing showing the detail of the screen shown in drawing 2 at the time of a user 

making gesture selection of the screen object according to another suitable example. 

[Drawing 9] It is the flow chart Fig. showing actuation of the graphical user interface of the intuitive 

gesture method by the suitable example. 

[Description of Notations] 

100 Electronic Instrument 

120 Push Button 

150 Pressure-sensitive Screen 

190 Pointing Device 

210,220,230 Screen object 

310 Area Which Carried Out Tap 

450 Direction Pallet 

451 North-Side (Cancellation) Pallet Carbon Button 

452 East Side (Transfer) Pallet Carbon Button 

453 On-the-South (Deletion) Pallet Carbon Button 

454 West Side (Return) Pallet Carbon Button 

455 Central (Read-out) Pallet Carbon Button 
620 Gesture Rhine 

750 SubPallet 

751 Northwestern Pallet Carbon Button 
753 Southwest Pallet Carbon Button 
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ocSTo *»C«, ^-tf^>< u h ♦ #4? >4 5 2 * 
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to oi3] m^it, &m&mzM&£*}*.~Tm4 
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f'^>^ 0 a eta. wa^ftwccjco^iw^^y- 

€>. H2fcCSr** U->C't^^r^o 
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